Serial No. 09/546,392 



camera 21/22, or in the case where it is not necessary to capture an image of a workpiece 
behind other workpieces by changing the orientation of the camera, the procedure may return to 
Step 200 when it is determined "Yes" in Step 205, to move the camera to another 
position/posture at which an image of the objective workpiece can be captured. 



IN THE CLAIMS: 

Please AMEND the claims in accordance with the following: 



(ONCE AMERCED) A robot system having an image processing function for 

' * irmipii 



determining orientation, or orien^tion and position of a robot operation on an object of detection, 
the system comprising: 
a robot; 

a first image capturing device? 

a memory storing reference mdfclels, each created based on an image of a reference 
object captured by said image capturincftdevice in a different direction, and for each reference 
model storing information of the capturing direction of its associated image and information of an 
orientation of the robot with respect to theVeference object, said reference object being the 
object of detection or having a shape substantially identical to that of the object of detection; and 

a processor to perform matching processing on an image of the object of detection 
(captured by said first image capturing device) using said reference models to select one of the 
reference models whose image of the reference object matched with the image of the object of 
detection, and to determine the orientation, ox the orientation and position of the robot operation 
to be performed on the object of detection, the determining based on the selected image of the 
reference object, based on said one reference model and the information of its associated 
capturing direction, and based on the information of the orientation of the robot with respect to 
the reference object that is associated with ^id one reference model. 

2. (ONCE AMENDED) A robot system having an image processing function 
according to claim 1, wherein said referenc| models are obtained from a part of the image data 
of the reference object. , 



~tr~ 



6. (ONCE AMENDEDm robot system having an image processing function 
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according to claim 1 , further comprising: 

a second image capwing device; wherein 

said robot situates saidWcond image data capturing device to have said determined 
orientation or to have said determined orientation and said determined position with respect to 
the object, and wherein 

said processor processes Second image data captured by said second image capturing 
device to detect position and/or posture of the object with respect to said second image data 
capturing device. 



7. (ONCE AMENDED) 
according to claim 1 further compris 

a second image capturing d 

said robot situates said secoi 
orientation or to have said determin 
the object, so that said second imag 
portion of the object; and wherein 

said processor detects three 
three-dimensional position of said ch] 
capturing device. 



robot system having an image processing function 

ice for obtaining three-dimensional position; wherein 
id image data capturing device to have said determined 
orientation and said determined position with respect to 
data capturing device is directed to a characterizing 

limensional position and/or posture of the object based on 
iracterizing portion obtained by said second image 



iy^fjT")^ (ONCE AMENDED) A robot system having an image processing function 
according to claim 7, wherein saiM robot operation is an operation of picking up at least one 
object from a plurality of objects o^rlapped with each other. 



12. (ONCE AMENDED) robot system having an image processing function for 
C\ determining orientation, or orientatiorfl and position of a robot operation on an object of detection, 
flQ the system comprising: 
a robot; 

a first image capturing deviceS 

a memory storing reference rrgodels, each created based on images of each of different 
kinds of reference objects captured tw said first image capturing device, and storing indicia of 
the kinds respectively associated witft said reference models, and information of a different 
orientation of the robot with respect Jo each of the different images of the reference object of 
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each kind, each of said kind of reference objects potentially being the object of detection or an 
object having a shape identical to that of the object of detection; and 

a processor to perform matching|processing on an image of the object of detection 
(captured by said first image capturing device) using said reference models to select an image 
of one of said kinds of reference models! and to determine the orientation, or the orientation and 
position of the robot operation to be performed on the object of detection, the determining based 
on the selected image of the reference object, based on said one reference model, based on the 
indicia of the kind associated with said ome reference model and the information of the 



orientation of the robot with respect to th 
model of said one kind. 



> reference object associated with said one reference 



13. (ONCE AMENDED) A ro|ot system having an image processing function 
according to claim 12, wherein said reference models are obtained from a part of the image data 
of the reference object. 



^^j^| 17 (ONCE AMENDEIjU\ robot system having an image processing function 
according to claim 12, further comprising a second image capturing device, wherein 

said robot situates said seconra image data capturing device to have said determined 
orientation or to have said determinealorientation and said determined position with respect to 
the object, and wherein 

said processor processes secojid image data captured by said second image capturing 
ftrv device to detect position and/or posture of the object with respect to said second image data 
' \c capturing device. 

18. (ONCE AMENDED) A^obot system having an image processing function 
according to claim 12, further comprising: 

a second image capturing dewice for obtaining three-dimensional position; wherein 

said robot situates said seccmd image data capturing device to have said determined 
orientation or to have said determined orientation and said determined position with respect to 
the object, so that said second im^ge data capturing device is directed to a characterizing 
portion of the object; and wherein] 

said processor detects three-dimensional position and/or posture of the object based on 
three-dimensional position of sail characterizing portion obtained by said second image 
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capturingllevice. 



22. (ONCE AMENDED) A robot system having an image processing function 
according to claim 18, wherein said robot operation is an operation of picking up at least one 
object from a plurality of objects overlapped with each other. 

23. (NEW) A method for automatically determining an arrangement of a workpiece 
relative to a robot, the robot comprising an imaging device affixed to an arm, the method 
comprising: 

storing reference images of the workpiece or an object so shaped (workpiece/object) and 
reference arrangement information indicating arrangements of the robot and workpiece/object 
relative to each other when the images were captured; 

from a known arrangement of the robot, capturing a working image of the workpiece with 
the imaging device; 

finding one of the reference images that has a closest match to the working image; and 
determining a known arrangement of the robot relative to the workpiece based on 
information indicating the known arrangement of the robot, and based on the reference 



24. (NEW) A method according to claim 23, wherein reference images and reference 
arrangement information is obtained for workpieces/objects of different shapes, and wherein the 
finding comprises first determining that a reference image of one of the different shapes 
matches the working image of the workpiece, and then finding one reference image of the shape 
that best matches the working image. 

25. (NEW) A method according to claim. 23, wherein the robot is used to capture the 
reference images, and wherein the reference arrangement information represents arrangements 
of the robot when capturing the reference images. 

26. (NEW) A method according to claim 23, wherein a second imaging device is 
affixed to the arm and is used to determine additional arrangement information used to 
determine the known arrangement of the robot relative to the workpiece. 




arrangement information corresponding to the found reference image. 
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